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(57) Abstract 

Record carrier, apparatus 
and method for playing back 
a record carrier, method of 
manufacturing a record carrier. 
On a record carrier (1) of the 
invention on which is recorded 
at least a first stream of data 
(2) representing a video item, 
a second stream of data (3) 
representing a graphics item, 
a control program (4) for 
controlling interactive playback 
of said items. The program (4) 
has a first (130) and a second 
program portion (140). The first 
program portion (130) comprises 
primary data (130.1). relating 
to shape properties of a graphics 
object. The second program 
portion (140) is to be executed 
after the first program portion in 
case of compliance of user input 
with a predetermined condition 
specified in the program, which 
second program portion (140) 
specifies a visual feedback in 
response to the user input, that 
the second program portion 
(140) comprises secondary data 

(151-156), relating to at least an additional visual property of the graphics object. The invention also pertains to an apparatus and a 
method for playing back a record carrier and a method for manufacturing the record carrier. 
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Record carrier, and apparatus and method for playing back a record carrier, and method of 
manufacturing a record carrier. 



The invention relates to an apparatus for playing back a record carrier on which 
are recorded at least a first stream of data representing a video item, a second stream of data 
representing a graphics item, and a control program for controlling interactive playback of said 
items, 

5 said apparatus comprising, 

means for selecting a stream of data to be read from the record carrier, which 
means are controlled by the control program, 

reading means for reading the control program and the selected stream from the 

record carrier, 

10 - video generating means for generating a pixel based representation of the video 

item in the first stream, 

graphics generating means for generating a pixel based representation of the 
graphics item in the second stream, 

input means for receiving user input, 
15 which apparatus is adapted for executing a first program portion of the control program which 
comprises at least primary data relating to shape properties of a graphics object, for executing 
a test for compliance of user input with a condition specified in the control program and for 
executing a second program portion of the control program for giving visual feedback in 
response to the user input, 
20 The invention further relates to a method for playing back a record carrier, said 

method comprising the following steps, 

reading a control program having a first and second program portion from the 

record carrier, 

executing the first program poition comprising primary data relating to shape 
25 properties of a graphics object, 

requesting user input, 

performing a test comprised in said program for compliance of said user input 
with a condition, 
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upon compliance of the user input with said condition executing the second 
program portion for giving visual feedback to the user input, 

selecting a stream of data representing a video item and/or a graphics item, the 
selection being dependent on the user input, 
5 - reading said stream from the record carrier and generating a pixel based 

representation from the item in said stream. 

The invention further relates to a record carrier on which is recorded at least 

a first stream of data representing a video item, 

a second stream of data representing a graphics item, 
10 - ■ a control program for controlling interactive playback of said items, which 

program has a first program portion which comprises primary data relating to shape properties 
of a graphics object and a second program portion which is to be executed after the first 
program portion in case of compliance of user input with a predetermined condition specified 
in the program, which second program portion specifies a visual feedback in response to the 
15 user input. 

The invention also relates to a method of manufacturing a record carrier 
according to which method 

a first stream of data representing a video item is stored at the record carrier, 
a second stream of data representing a graphics item is stored at the record 

20 carrier, 

a control program for controlling interactive playback of said items is stored at 
the record carrier, which program has a first program portion which comprises primary data, 
relating to shape properties of a graphics object and a second program portion which is to be 
executed after the first program portion in case of compliance of user input with a 
25 predetermined condition specified in the program, which second program portion specifies a 
visual feedback in response to the user input, 

characterised in that the second program portion comprises secondary data, relating to at least 
an additional visual property of the graphics object. 



30 



The SVCD standard as layed down in the working draft 
SC100B/NP177/PTD-003 specifies an apparatus for playback of play items , a play item being 
an audio, and/or a video and/or a graphics item. If so desired a graphics item can be 
reproduced synchronously with a video item, e.g. in the form of subtitling accompanying a 
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video item. A pixel based representation is to be interpreted as a representation in the form of 
a two-dimensional array of picture elements. According to the S VCD standard the apparatus is 
to comprise means for controlling interactive playback of the items at the record carrier by 
means of a play back control program. This program comprises structures denoted as "play 
5 list" and "selection list". The former structure specifies a sequence of play items to be played 
sequentially. The latter structure enables a user to choose which play items are to be 
reproduced and in which order. The selection list contains amongst others a reference to a play 
item. The latter is for example a graphics item which comprises a graphics object representing 
a menu having different menu parts which correspond to play items at the record carrier which 

10 are available to the user. The menu pans for example are in the form of a short description of 
the corresponding play item or a logo representing the available play item. The shape 
properties of a graphics object are defined as properties necessary to reconstruct the shape of 
the graphics object in the pixel based representation. In the SVCD standard the shape 
properties are defined in the structure "display data" in the fonn of runlength encoded data. 

15 The reference in the selection list is primary data relating to the shape properties in that it 
refers to the graphics item comprising the display data. The selection list in addition contains 
references to play items from which the user can make a choice (available play items) and 
assigns a rectangular region to each of the available play items. By pointing at a rectangular 
region, the user can focus on an available play item. That available play item can subsequently 

20 be activated by the user, for example by pushing a button. By focussing on or activating an 

available play item the menu part within the corresponding rectangular region is highlighted as 
a visual feedback upon the user input. Highlighting of the rectangular region is realised by 
means of a color lookup table. In the rectangular region corresponding to the play item which 
is focussed upon or activated the color lookup table is loaded with color values differing from 

25 those outside the rectangular region. This has the disadvantage that a menu pan can only be 
highlighted individually if that menu part has a rectangular region which does not contain 
another menu part. This restricts the feedback capabilities of the known apparatus. 



30 It is a purpose of the invention to provide means which enable an improved 

feedback upon user input. 

According to this purpose the apparatus is characterized in that, the second 
program portion of the control program comprises secondary data which relates to an 
additional visual property of the graphics object, the apparatus being adapted for generating 
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the visual feedback by reproducing a pixel based representation of the graphics object on the 
basis of the primary data and the secondary data. 

According to this purpose the method for playing back is characterised in that 
the second program portion comprises secondary data relating to at least one additional visual 
property of the graphics object and in that the visual feedback is a representation of the 
graphics object on the basis of the primary and the secondary data. 

According to this purpose the record carrier of the invention is characterised in 
that the second program portion comprises secondary data, relating to at least an additional 
visual property of the graphics object. 

According to this purpose the method for manufacturing a record carrier is 
characterised in that the second program portion comprises secondary data relating to at least 
an additional visual property of the graphics object. 

The measures of the invention enable an improved response to user input. 
According to these measures execution of the second program portion of the control program 
has the effect that an additional visual property to which the secondary data is related is 
assigned to the graphics object, the shape properties of which were assigned in the first 
program portion. 

An attractive embodiment is characterised in that the graphics object comprises 
two or more parts, for example menu parts, having mutually different color codes and in that 
the secondary data relates to at least one color vale which is to be assigned to a color code. By 
assigning a color value to a part of a graphics object, instead of assigning the color to a region 
it is possible to individually highlight that part even in the case that no region exists which 
exclusively contains said part. 

In practice some tens of available play items may be available at the record 
carrier. In an attractive embodiment the color code is represented by at least 6 bits. This 
enables the apparatus to separately highlight an object part corresponding to each of the 
available play items. 

Another additional visual property is for example visibility. This property may 
be used to selectively display one of a set of object parts. The set of object parts is for example 
a set of arrows which each point to a further set of object parts which each symbolize an 
available play item. Again another additional visual property of a graphics object which can be 
assigned is for example the location at which it is to be displayed. A further additional visual 
property of a graphics object is its orientation. The graphics object in the latter two cases is for 
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example an arrow which is overlayed on a video image. Visual feedback is given by having 
the arrow point to an object within the video image. 

Preferably the primary data is related to the shape properties in that the primary 
data is a reference to a data structure comprising shape data representing the shape properties. 
This has the advantage that the control program can be relatively small, so that it can be easily 
resided in an internal memory of the apparatus for playing back. Otherwise the control 
program may comprise the shape data. In both cases the feedback to user input is not retarded 
by loading the shape data, because loading has already taken place before the user input is 
requested. 

Preferably the datastructure comprises further data, the secondary data 
being related to the additional visual property in that the secondary data comprises 
modification data which includes a reference indicating the location of said further data within 
the datastructure, the modification data and the further data representing the additional visual 
property. This has the advantage that the modification data and therewith the control program 
can be compact. Said datastructure comprising the shape data and the further data can already 
be loaded in a memory of the apparatus before the user input is requested so that the process of 
loading the further data does not retard the visual feedback. 

The control program may comprise a plurality of first and second program 
portions for example to present a nested structure of menus to the user. As the datastructures 
are not included in the program, but referred to by the primary data only that datastructure 
which is relevant to the current request for user input need be present in the memory, so that 
the amount of memory required is limited. 

It is particularly advantageous if the further data comprises one or more color 
values. A relatively large set of color values may be required to enable visual feedback in 
practical cases. By this measure it is achieved that the set of color values need not be 
incorporated in the control program. The modification data included in the program is for 
example in the form of a command comprising the reference which instructs a play back 
apparatus to load one or more color values into a color lookup table starting from a location in 
memory indicated by the reference. 

In an advantageous embodiment of the record carrier the data comprised in the 
second stream and the data related to the graphics object are in a form which can be processed 
by common graphics generating means. This has the advantage that an apparatus can be used 
in which the graphics generating means not only generate a pixel based representation of the 
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graphics item in the second stream, but also generate the pixel based representation of the 
graphics object. 

The apparatus preferably is adapted for executing timing commands in the 
control program. This has the advantage that the visual feedback can be given in a dynamic 

5 form. A dynamic visual feedback provides an efficient way to alert the user. 

An attractive embodiment of the apparatus is characterised in that the graphics 
generating means comprise graphics decoding means for generating an intermediate pixel 
based representation, storage means for storing the intermediary pixel based representation 
and graphics modification means for generating a pixel based representation from the 

10 intermediary pixel based representation on the basis of the modification data. This 

embodiment makes it possible to store the intermediary pixel based representation of the 
graphics object before user input is requested and to compute a pixel based representation 
from that intermediary pixel based representation after the user input is received. Therewith, 
the response time between user input and visual feedback is further shortened. 

15 Several possibilities exist for representing the shape of the graphics objects. The 

shape date may for example be in the form of a set of codes which indicate for each of a set of 
pixels whether it is a background pixel or whether it is an object pixel. In case that the object 
contains more than one part the code may indicate to which pan the pixel belongs. The shape 
data may for otherwise be in a compressed form, for example in the form of a contour based 

20 coding, for example a coding of parts in the object in the form of a list of lines bounding the 
object. In another embodiment the object parts are encoded in the form of a block code, 
wherein the shape of the object part is encoded in the form of a plurality of blocks of 
decreasing size. In a preferred embodiment the shape data is compressed in the form of a run 
length code. This has the advantage that the intermediary pixel based representation can be 

25 generated with relatively simple hardware while a considerable data reduction is achieved. 

It is noted that the first and the second streams are not necessarily separate from 
each other. They may be multiplexed in a common stream. Multiplexing the video and the 
graphics stream is very useful if a video item and a graphics item (for example subtitling) are 
to be reproduced synchronously with each other. 

30 In an embodiment the apparatus of the invention has digital outputs for 

providing a first, a second and a third image signal which respectively represent the pixel 
based representation of the video item, the pixel based representation of the graphics item and 
the pixel based representation of the graphics object to a display device. A third image signal 
is superfluous in an embodiment of the apparatus wherein the graphics generating means both 
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generate the pixel based representation of the graphics item and the pixel based representation 
of the graphics object. 

The display device referred to in the previous paragraph may on its turn have 
combination means for generating a resulting pixel based representation from said image 

5 signals, and a video generator for generating a video signal from said resulting pixel based 
representation. Otherwise the display device may have a video generator for generating an 
elementary video signal from each of the incoming image signals and combination means for 
generating a resulting video signal from the elementary video signals. The combination means 
may for example superpose the image/video signals, or temporarily select one of the 

10 image/video signals or locally select one of the image/video signals. The modification data of 
a graphics object may contain data relating to a setting of the combination means. 

Such a display device may be integrated with the apparatus of the invention. 



15 These and other aspects are elucidated in more detail with reference to the drawings. Therein: 
Figure 1 schematically shows a record carrier according to the invention, 
Figure 1 A schematically shows a datastructure stored at the record carrier, 
Figure 2 shows a flowchart of the control program, 
Figure 3 shows an example of a form of visual feedback, 

20 Figure 4 shows a further example of visual feedback, 

Figure 5 schematically shows an embodiment of an apparatus according to the 

invention. 

Figure 1 schematically shows a record carrier 1 according to the invention. On 
the record carrier is recorded at least a first stream 2 of data representing a video item. The 
25 video item is preferably encoded in MPEG format. The record carrier comprises a second 

stream 3 of data representing a graphics item. The second stream 3 is in the form of a sequence 
of graphics pages. Said pages comprise shape data representing shape properties of at least one 
graphics object and modification data representing additional visual properties of said graphics 
object. 

30 In the present example the second stream 3 is separate from the first stream 2. 

Otherwise the first and the second stream can be multiplexed. For example the first stream is 
encoded as an MPEG2 transport stream and the second stream is accomodated in the form of a 
private data stream in the MPEG2 transport stream. 
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In a preferred embodiment a graphics page comprises in addition to the shape 
data and the modification data a header and color lookup table data, also denoted as clut data. 
The contents of a graphics page are indicated in more detail in Table 1. Therein, these four 
categories of data are indicated by capitals. 



Table 1: Syntax of a graphics page 



Syntax 


No. of bits 


HEADER 




page_start_code 


16 


reserved I 


8 


page_datajength 


24 


duration 


32 


reserved2 


8 


COLOR LOOKUP TABLE DATA 




clut_datajength 


24 


for (i=0; 4*i < clut__datajength ; i++){ 




clut_element_Y 


8 


clut_element_Cr 


8 


clut_e!ement_Cb 


8 


stuffing_byte 

i 


8 


SHAPE DATA 




number_of_objects 


8 


total_object_data_length 


24 


for (i=0; i<number_of_objects; i++){ 




object_data() 

} 




MODIFICATION DATA 




page_control() 





The semantics of the fields included in the graphics page is as follows. 
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In the category "HEADER": 

* page_start_code indicates at how many bits per pixel the graphics page is to be 
displayed. For example the values 0x4734 and 0x4738 respectively indicate that display at 4 
bits per pixel and display at 8 bits per pixel is intended. 

5 * page_datajength indicates the length of the graphics page in bytes 

* duration specifies the length of the time interval during which the graphics 
page is to be displayed. 

* reservedl and reserved2 leave space for future developments. 
In the category "COLOR LOOKUP TABLE DATA": 

10 * clut_data_Iength indicates the number of color lookup table data bytes. 

* clut_element_Y, clut_element_Cr, clut_element_Cb and stuffing_byte 
respectively represent the luminance data for a CLUT entry, the Cr chrominance data for said 
CLUT entry, the Cb chrominance data for said CLUT entry and a stuffing byte, the latter for 
example having the value 0x00. 

15 In the category "SHAPE DATA": 

* number_of_objects indicates the number of graphics objects which is included 
in the graphics page. 

* total_object_data Jength indicates the total number of bytes for all 
object_data. 

20 * object_data is described in more detail with reference to Table 2. 

In the category "MODIFICATION DATA": 

The modification data is in the form of one or more commands in a structure page_control. 
The latter structure is described in more detail with reference to Table 6. 
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10 
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Syntax 


XT U! k . si 

No. of bits y 


obj ec t_data__s tan_c ode 


16 


object_id 


8 


object_data_length 


24 


object_width 


10 


object_height 


10 


reserved 


2 


bpp 


2 


top_fieId_data_)ength 


16 


bottom_field_data_length 


16 


for (i=0; i<object_height; i+-f){ 




line_of_pixeLdata_for_top_field() 




end_of_l ine_code 

} 

for (i=0; i<object_height; i++){ 


8 




line_of_pi xel_data_f or_bottom_f i eld() 




end_of_line_code 

} 

if(!wordalignedO){ 


8 




zero_byte 

} 


8 



The following semantic definition applies to the fields shown in this table. 

* object_data_start_code has a predetermined value which indicates the 
beginning of the object_data. 

* object Jd can be used to identify different objects within one graphics page. 

* object_data Jength specifies the number of bytes in an object. 

* object_width indicates the number of pixels on each horizontal line of the 
graphics object 

* object_height indicates the number of lines in each of the two fields composing 
the graphics object. 
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* bpp defines the number of bits per pixel in the decoded graphics object. The 

number of bits is for example defined according to Table 3. 



Table 3: Example of a definition of bpp. 



bpp 


Meaning 


'00' 


reserved 


•or 


2 bits per pixel 


•10' 


4 bits per pixel 


•ir 


8 bits per pixel 



5 

* top_field_data Jength is an integer equal to the total number of bytes of all 
pixel data for the top field including the end_of Jine_codes. 

* bottom_fieId_data_length is an integer equal to the total number of bytes of 
all pixel data for the bottom field including the end_of_line_codes. 

10 * end_of _line_code is a field containing a predetermined value to indicate the 
end of each line. 

* The fields line_of_pixel_data_for_bottom_fieId() and 
Iine_of_pixe!_data_for_top_Jield() may comprise one or more blocks of data corresponding 
to the syntax of line_of_pixel_data as described in Table 4. 



15 
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Table 4 Syntax of line_of_pixeLdata 



Syntax 


No. of bits 


datatype 


8 


if (datatype == Ox 10) { j 




bpp2_code_block() 




end_of_bpp2_code 

} 

if (datatype — Ox 11){ 


6 




bpp4_code_block() 




end_of_bpp4_code 

} 

if (datatype = 0x12) { 


8 




bpp8_code_block() 




end_of_bpp8_code 

) 

whi le( ! byteali gned()) { 


16 




| zero_b>t 
1 


1 



The following semantic definitions apply to the elements in the table: 
* datatype identifies the type of information in the code block immediately 

following this field. In the present embodiment the information may be identified according to 
Table 5. 



Table 5 meaning of datatype. 



datatype 


meaning 


0x10 


next field is a bpp2_code_block 


0x11 


next field is a bpp4_code_block 


0x12 


next field is a bpp8_code_block 


others 


reserved 
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A bpp2_code_block() comprises runlength encoded data of one pixel or a sequence of pixels 
with color codes in the range from 0-3. An example of such a bpp2_code_block is the code as 
described in PHB 34241, which is incorporated by reference in the present description. 
The field end^of_bpp2_code has a predetermined content, for example six zero bits, to 
5 indicate the end of a bpp2_code_block. 

A bpp4_code_block() comprises runlength encoded data of one pixel or a sequence of pixels 
with color codes in the range from 0-15. The bpp4_code_block() can be defined in a form 
analogous to the bpp2_code_b!ock() 

The field end_of_bpp4_code has predetermined content, for example eight zero bits, to 
10 indicate the end of a bpp4_code_block. 

A bpp8_code_block() comprises runlength encoded data of one pixel or a sequence of pixels 
with color codes in the range from 0-255, The bpp8_code_block() can be defined in a form 
analogous to the bpp2_code_block(). 

The field end_of_bpp8_code has a predetermined content, for example sixteen zero bits, to 
15 indicate the end of a bpp8_code_block. 

In order to achieve that the field Hne_of_data comprises an integer number of bytes the field 
is completed with zero bits if necessary according to the instruction "while(!bytealigned()){ 
zero_bit }". 

In the following description the modification data defining additional visual 
20 properties of a graphics object are worked out in more detail. The modification data is stored 
at the record carrier in the form of commands in a structure referred to as M page_controI n . 
The syntax of page_control is described in Table 6. 



Table 6 Syntax of page_control. 



Syntax 


No. of bits 


page_controLstart_code 


16 


reserved 


8 


page_control_length 


24 


loop_count 


16 


while(processed_length<page_controlJenglh){ 




rel ati ve_t i me_stamp 


32 


command_list() 

) 





25 
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The semantics of the fields in the above table are described below. 

* page_controLstart_code is a predefined value which indicates the start of 
page control information. 

* page_control_length is an unsigned integer which indicates the number of 
5 bytes in page_control() following this field. 

* With the field loop_count it can be specified how many times the execution of 
a sequence of commands is to be repeated. Preferably a zero value means that the command 
sequence is executed once. 

* The field relative_time_stamp enables a timing of the execution of the com- 
10 mandJistO following this field. 

* The field command_Iist comprises one or more commands which define 
additional properties of a graphics object. The syntax of the field command_list is described in 
Table 7. 



15 Table 7 Syntax of comrnand_list. 



syntax 


No. of bits 


command Ji strength 

while(processedJength<command_list_length){ 
command() 

} 


16 


The semantics of the fields included in the table are as fol 


ows: 



* command _list Jength is an unsigned integer indicating the number of bytes 
occupied by the commands following this field. 

* A commandO determines a property of an object to display. The command has 
20 a first byte indicating the type of command and may have further bytes that form arguments of 

the command: An example is a command M pageJoad_clut" which assigns colors <o the color 
codes. The syntax of this command is defined in the Table 8. 
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Table 8 Syntax of the command "pagejoad.clut". 



Syntax 


No. of bits 


command_code 


8 


clut_data_start_element 


24 


clut_start_entry 


8 


number_of_entries 


8 



The semantics of this command is as follows: 

* command_code is a field identifying the command. This command is intended 

5 for loading data in a color lookuptable which assigns colors to the color ^odes. When this 
command is executed, a number of clut_elements equal to number_of_entries is loaded from 
the CLUT data comprised in the graphics page into the color lookup table. The data is loaded 
in ascending order. clut_data_start_element is the index of the first clut_element in the 
CLUT data which is loaded. It is loaded into the entry of the color lookup table having index 

10 clut_start_entry. 

The record carrier further comprises a control program 4 for controlling 
playback of the video and/or graphics and or audio items. 

By way of example Figure 2 shows a flowchart schematically showing a 
method for playing back a record carrier according to the invention. In a first program section 

15 1 10 the control program 4 is read from the record carrier. The control program 4 for example 
has the form of a set of linked lists. The set comprises at least a first type of list, hereafter 
denoted as play list which defines a set of audio and/or video and/or graphics items that are 
playable in sequence. The set further comprises a second type of list, hereafter denoted as 
selection list which defines branching in the sequence of play items upon user control. 

20 In the present example the control program starts with a play list. Accordingly 

this playlist is executed in program section 120. This play list may for example show an 
overview of the contents of the record carrier. If execution of the playlist is finished or 
interrupted control is passed to a first selection list. The selection list has a first portion 
forming a first program portion and a second portion forming a second program portion. The 

25 first program portion executed in program section 130 comprises primary data 130.1 relating 
to shape properties of a graphics object. In this embodiment the primary data is a reference to 
a data structure 5. This datastructure, which is schematically shown in Figure 1 A, comprises 
shape data 5.3, representing the shape properties of the graphics object. In the present example 
the data structure 5 also contains other data, i.e. header 5.1, color lookup table data 5.2 and 
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modification data 5.4, required to make up a graphics page as is described with reference to 
Table 1. The data structure 5 and the control program 4 are stored in mutually non-overlapping 
data areas at the record carrier 1, so that the record carrier 1 can be easily loaded from the 
record carrier without loading the data structure 5. During execution of the first program 
5 portion 130 the datastructure 5 is read from the record carrier 1 and stored in a memory. By 
execution of the first program portion 130 a graphics image representing the one or more 
objects at the graphics page S is generated. The user is subsequently requested for input. 

The selection list comprises a second portion 140, comprising program sections 
141-146, forming a second program portion. The second portion 140 is to be executed after the 
10 first program portion 130 in case of compliance of user input with a predetermined condition 
specified in the program. The latter is verified in program sections 131, 132, 133 and 134. 
Program section 131 discriminates the selection I, II or III indicated by the user and program 
sections 132, 133 and 134 discriminates whether the user focusses (F) on or activates (A) a 
selection. The second program portion 140 having program sections 141-146 specifies a visual 
15 feedback in response to the user input. The second program portion 140 comprises secondary 
data (151-156). The secondary data comprises modification data which includes a reference to 
further data within the data structure 5. Here the further data comprise one or more color 
values in the CLUT data 5.2 in the data structure 5. More in particular the modification data is 
a command "page Joad_clut" as described with reference to Table 8. The reference to the 
20 further data is formed by the entry "clut_data_start_element" mentioned in said table. In 

particular the second program portion comprises three groups of modification data, 151+152, 
153+154 and 155+156 for each of three selections. Each group of modification data has a first 
subgroup 151, 153 and 155 and a second subgroup 152, 154 and 156. The first subgroup of 
modification data is to be assigned to the graphics object if the user focusses on the correspon- 
25 ding selection. The second subgroup is to be assigned to the graphics object if the user . 

activates the corresponding selection. The modification data in each of the first and second 
subgroups differ from each other in that the pageJoad_clut commands have mutually different 
values in the entry denoted by clut_data_start_element. 

By activating a selection a reproducable item corresponding to that selection is 
30 executed in programsection 147, 148 or 149. By focussing on a selection it is not executed yet, 
but the user can indicate that this selection is to be executed if an activate command is given 
next. The second program portion 140 comprises a reference to a list (for example a play list) 
which is to be executed if the corresponding selection is activated. An example of an initial 
graphics image generated for said purpose is shown in Figure 3. The shape data 5.3 in the 
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datastructure 5 referred to by the primary data in the first program portion 130 of the control 
program comprises at least shape data of a graphics object comprising the following object 
parts: a first 201, a second 202 and a third arrow 203 and the wordings "Choose an option" 
204. The graphics object in addition comprises the wordings: "option I" 205, "option II" 206 
5 and "option III" 207. These wordings respectively correspond to the first I, second II and third 
selection m. The background, not belonging to the object, is indicated by reference numeral 
200. 

During processing of the first program portion 130 an intermediary pixel based 
representation is generated from the shape data 5.3 which is referred to by the primary data 

10 130.1. In the intermediary pixel based representation each pixel is assigned a color code 

corresponding to one of the object parts (201-207) or to the background (200). The color code 
is represented by at least 6 bits, here 8 bits. Subsequently a pixel based representation is 
obtained by means of a color lookup table which assigns a color value representing a color to 
each of the color codes. The following table gives an example how the color codes are 

15 assigned to the background and the object pans, and how colors are assigned to the color 
codes. 



object part/background 


color code 


color 


background 


0 


"blue" 


"Choose an option" 


1 


"yellow" 


"option I" 


2 


green 


"option II" 


3 


"green" 


"option nr 


4 


"green" 


"arrow 1" 


5 


"red" I 


"arrow 2" 


6 


"blue" 


"arrow 3" 


7 


"blue" 



The result of the above assignment of colors is that only the first 201 of the three arrows 201- 
20 203 is visible, so that it is clear to the user that initially the selection I referred to by "option I" 
is focussed upon. At the moment that the user provides input indicating that it is desired <o 
focus upon another selection, for example by pointing with a pointing device, a second portion 
of the list is executed. If for example the user points at a rectangular area corresponding to the 
wordings "option II" a pixel based representation of the graphics object is reproduced on the 
25 basis of the primary data 130.1 and the relevant secondary data, here the modification data 
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153. In the present example the modification data 153 is in the form of a command 153 
page_load_cIut. Execution of this command has the effect that a set of color values is read 
from memory starting at a location indicated by clut_data_stan_element and written in the 
color lookup table starting at a location clut_start_entry. The number of color values written in 
the color lookup table is defined by number_of_entries. This has the effect that the color 
values corresponding to the colors "blue", "red", "blue 11 respectively are assigned to the color 
codes 5, 6 and 7 respectively. Now arrow 2 becomes visible and arrow 1 becomes invisible, so 
that it is clear to the user that now the second selection II is focussed upon. In the same way 
arrow 3 may be made visible, in order to focus upon the third selection III. If the user decides 
to activate a selection in order that the corresponding item is reproduced, the corresponding 
object part may be highlighted by assignment of further modification data in the second 
portion of the selection list, until said option is actually carried out. For example the wordings 
"option m M corresponding to the third selection III may be highlighted by assigning a color 
value corresponding to a bright shade of green to color pointer 4 in program section 146. 

To give an even more notable feedback the secondary data in the second 
program portion 140 may contain page_control information which comprises a first 
relative jime_stamp, a first commandjist, a second relative time stamp and a second 
commandjist. The first relative jime_stamp is set to a value corresponding to a time interval 
of 0 seconds, so that the first commandjist is executed immediately after activation by the 
user. The first commandjist for example again comprises a command which assigns the color 
value corresponding to said bright shade of green to color code 4. The second 
relative_time_stamp is corresponding to a time interval of for example 1 second. The second 
commandjist comprises a command which assigns a color value corresponding to the color 
"green" again to the color code 4. This page_control information has the effect that the 
wordings "option III" blink. The commands may be repeated for a number of times which is 
specified by the field loop_count in the page_control information (See table 6). At the moment 
that the reproduction of the activated item starts, the display of the graphics page is 
interrupted. 

The apparatus of the invention has already executed the first program portion, 
i.e. a first portion of the selection list when the user is prompted for input. After input of the 
user the apparatus only has to execute commands which assign additional visual properties to 
the graphics object the shape of which was already described in the shape data referred to by 
the primary data in the first portion of the list. It is not necessary to load the shape data again, 
so that the apparatus can give a fast feedback to the user input. 
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As a further example a record carrier of the invention may comprise travel 
information about a plurality of countries. For that purpose the record carrier comprises play 
items for each of those countries. Selection of those play items is enabled by a control program 
at the record carrier. The first portion of that control program comprises primary data in the 
5 form of a reference to shape data which is comprised in a complete graphics page. This 

graphics page, which is the form set out in Table 1, represents a map showing the plurality of 
countries e.g.£djmtries 301-308 as illustrated in Figure 4. Each of the object parts representing 
a country is assigned a unique color code and each color code is assigned an initial color value 
such that no two neighbouring countries are displayed with the same color. The color code is 
10 represented by at least 6 bits, here 8 bits. Subsequently the user is requested for input. By 
pointing at a location at the map, the user can focus on one of the countries. Upon this user 
input a second program portion of the control program comprising secondary data is executed 
so that a new pixel based representation of the graphics object is reproduced on the basis of the 
primary data and the secondary data. In the present example the secondary data is another set 
15 of color values which is to be assigned to the color codes. This has the effect that the object 
part 301 representing the country which is focussed upon is displayed with a different color, 
preferably a color not occurring elsewhere on the map. 

In a method in accordance with the SVCD standard, the user input would be 
reflected by highlighting a rectangular region 310 containing the country 301. This would 
20 have the effect however that also neighbouring countries 302-308 are highlighted in so far as 
they are enclosed by that region 310. This is confusing to the user because it is not clear which 
country is focussed upon. Another disadvantage is that it is not possible to use a single color 
for highlighting, because that would entail that the boundaries between the country focussed 
upon and its neighbouring countries are not visible within the rectangular region 310. 
25 Figure 5 diagrammatically shows an apparatus for playing back a record carrier 

as described with reference to Figure 1. The apparatus comprises means 421, here in the form 
of a central processor, which are controllable by the control program. The apparatus further 
comprises read means 410. The read means 410 are provided with control means 41 1 to select 
data, for example a stream of data, at the record carrier upon instructions by address signals 
30 412 from the central processor 421. The read means serve for reading the control program 4 
and the selected stream from the record carrier 1. An output 413 of the read means 410 is 
coupled to a system bus 420 of a customary computer system for delivering the read 
information over a data signal path 414. Furthermore a central processor 421, a RAM 422, and 
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a ROM 423 are connected to the system bus 420. The apparatus is provided with input means 
424 and 425 for receiving user input. 

The apparatus further has demultiplexing means 430 for receiving a data stream 
from the reading means 410 via the systembus 420. The demultiplexing means 430 

5 demultiplex the data stream into a first stream, a second stream and a third stream which are 
contained in the datastream. A first output 431 of the demultiplexing means 430 is coupled to 
an input buffer 440 of video decoding means 441 for reproducing a pixel based representation 
442 of the video item from the first stream. A second output 432 of said demultiplexing means 
430 is coupled with an input buffer 450 of a first page store 451 for graphics decoding means. 

10 A third output 433 of the demultiplexing means 430 is coupled to an input buffer 431 of audio 
decoding means 432. The first page store 451 is intended for storing a graphics page. An 
output of said page store 451 is coupled to a first input 452 of selection means 454. An output 
of said selection means 454 is coupled with graphics decoding means 455 for generating an 
intermediary pixel based representation 456 from the shape data in the second stream. In the 

15 intermediate pixel based representation 456 each pixel is assigned a color code corresponding 
to an object part. An output of the graphics decoding means 455 is coupled to modification 
means 457A and 457B for generating a pixel based representation 458 from the intermediary 
pixel based representation 456 and the modification data. In the present embodiment the 
modification means comprise a color lookup table 457A which assigns a color to each color 

20 code generated by the graphics decoding means 455, a blending table 457B which assigns a 
blending factor to each color code and a blender 457C. The blender 457C generates a resulting 
pixel based representation 458 from the incoming signals, i.e. the signal 442 representing the 
pixel based representation of the video item and the pixel based representation generated by 
the modification means 457A and 457B and from a back drop signal generated by a 

25 background generator 459. The weighting factors for combining the signals recieved by the 

blender 457C are determined by the signal generated by the blending table 457B. The graphics 
decoding means 455, the color lookup table 457A, the color blending table 457B and the 
blender 457C form graphics generating means. 

The apparatus is adapted for executing a first program portion 130 of the 

30 control program 4 which comprises at least primary data relating to shape properties of a 

graphics object. The apparatus further is adapted for executing a test 131-134 for compliance 
of user input with a condition specified in the control program 4 and for executing a second 
program portion 140 of the control program 4 for giving visual feedback in response to the 
user input. 
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The apparatus of the invention is characterised in that it is adapted for executing 
a control program 4 in which the second program portion 140 comprises secondary data 151- 
156 which relates to an additional visual property of the graphics object. The apparatus of the 
invention is further adapted for generating the visual feedback by reproducing a pixel based 
representation 458 of the graphics object on the basis of the primary data 130.1 and the 
secondary data 151-156. To that end the apparatus comprises a second page store 460 for 
storing a graphics page 5 comprising shape data 5.3 and modification data 5.4 of the graphics 
object. An input of said second page store 460 is coupled to the system bus 420, so that the 
central processing unit 421 , when processing a control program 4, can load the data structure 5 
comprising the shape data 5.3 and the modification data 5.4 into the second page store 460. 
During processing of the first program portion 130 of the control program 4, the apparatus 
loads the datastructure comprising the shape data 5 from a location at the record carrier 1 
referred to by the primary data 130.1. An output of the second page store 460 is coupled to a 
second input 453 of the selection means 454. In the embodiment of Figure 5 the graphics 
decoding means 455, here in the form of a run length decoder, generate the intermediary pixel 
based representation 456 on the basis of the primary data in the control program 4. The 
graphics modification means 457 A, 457B, 457C generate the pixel based representation 458 
from the intermediary pixel based representation 456 on the basis of the secondary data in the 
control program 4. HeTe the secondary data is modification data comprised in the control 
program 4. The apparatus has storage means 461 for storing an intermediate representation 
456 of a graphics object, so that it is not necessary to recompute the intermediate 
representation 456 each time that new modification data are loaded into the second page store 
460. The amount of hardware can be limited because the graphics generating means 455, 
457A, 457B, 457C are both used to generate a pixel based representation 458 of the graphics 
items in the second stream 3 delivered by the second output 432 of the demultiplexer 430 and 
of the graphics objects referred to by the control program 4. In order to achieve that either a 
graphics image is reproduced from the second stream 3 or from the graphics object referred to 
by the control program 4, the selection means 454 select one of the signals received at the first 
and the second input 452, 453 thereof. The selection is determined by a control signal Sw sent 
by the CPU 421 to the selection means 454 via the system bus 420. The apparatus is adapted 
for executing timing commands in the control program. To that end the apparatus comprises 
timing means 462. 
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CLAIMS: 



1. Apparatus for playing back a record carrier (1) on which are recorded at least a 
first stream (2) of data representing a video item, a second stream (3) of data representing a 
graphics item, and a control program (4) for controlling interactive playback of said items, 
said apparatus comprising, 

5 - means (42 1 , 4 1 1 ) for selecting a stream of data to be read from the record 

carrier, which means (421, 41 1) are controllable by the control program (4), 

reading means (410) for reading the control program (4) and the selected stream 
(2, 3) from the record carrier (1), 

video generating means (441 , 457C) for generating a pixel based representation 
10 (458) of the video item in the first stream (2), 

graphics generating means (455, 457A, 457B, 457C) for generating a pixel 
based representation (458) of the graphics item in the second stream (3), 

input means (424, 425) for receiving user input, 
which apparatus is adapted for executing a first program portion (130) of the control program 
15 (4) which comprises at least primary data (130.1) relating to shape properties of a graphics 
object, for executing a test for compliance of user input with a condition specified in the 
control program and for executing a second program portion (140) of the control program (4) 
for giving visual feedback in response to the user input, 
characterised in that, 

20 the second program portion (140) of the control program (4) comprises secondary data (151- 
156) which relates to an additional visual property of the graphics object, the apparatus being 
adapted for generating the visual feedback by reproducing a pixel based representation (458) 
of the graphics object on the basis of the primary data (130.1) and the secondary data (151- 
156). 

25 

2. Apparatus according to Claim 1, characterised in that the graphics object 
comprises two or more parts (201-207) having mutually different color codes, and in that the 
secondary data (151-156) relates to at least one color value which is to be assigned to a color 
code. 
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3. Apparatus according to Claim 2, characterised in that the color code is 
represented by at least 6 bits. 

4. Apparatus according to Claim 1, characterised in that the primary data (130.1) 
5 is related to the shape properties in that the primary data comprises a reference to a data 

structure (5) comprising shape data (5.3) representing the shape properties. 

5. Apparatus according to Claim 4, characterised in that the datastructure (5) 
comprises further data and in that the secondary data (151-156) is related to the additional 

10 visual property in that the secondary data comprises modification data which includes a 

reference indicating the location of said further data within the datastructure, the modification 
data and the further data representing the additional visual property. 

6. Apparatus according to Claim 5, characterised in that the further data comprises 
1 5 one or more color values. 

7. Apparatus according to Claim 1, characterised in that the graphics generating 
means (455, 456, 457A, 457B, 457C) also generate the pixel based representation (458) of the 
graphics object. 

20 

8. Apparatus according to Claim 1 , characterised in that the apparatus is adapted 
for executing timing commands in the control program. 

9 # Apparatus according to Claim 1, characterised in that the graphics generating 

25 means comprise graphics decoding means (455) for generating an intermediate pixel based 
representation (456), storage means (461) for storing the intermediary pixel based 
representation (456) and graphics modification means (457 A, 457B, 457C) for generating a 
pixel based representation (458) from the intermediary pixel based representation on the basis 
of the modification data (151-156). 



30 



10. Apparatus according to Claim 9 f characterised in that the graphics decoding 

means (455) comprise a runlength decoder. 
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11. Method for playing back a record carrier, said method comprising the following 

steps, 

reading (1 10) a control program (4) having a first (130) and second program 
portion (140) from the record carrier (1), 
5 - executing the first program portion (130) comprising primary data (130.1) 

relating to shape properties of a graphics object, 

requesting user input, 

performing a test comprised in said program for compliance of said user input 
with a condition (131-1 34), 
10 - upon compliance of the user input with said condition executing the second 

program portion (140) for giving visual feedback to the user input, 

selecting (142, 144, 146) a stream (2, 3) of data representing a video item 
and/or a graphics item, the selection being dependent on the user input, 

reading said stream from the record carrier (1) and generating a pixel based 
15 representation from the item in said stream (147, 148, 149), 

characterised in that the second program portion (140) comprises secondary data (151-156) 
relating to at least one additional visual property of the graphics object and in that the visual 
feedback is a representation of the graphics object on the basis of the primary (130.1) and the 
secondary data (151-156). 

20 

12. Method according to Claim 1 1 , characterised in that the graphics object 
comprises two or more parts (201-207) having mutually different color codes, and in that the 
secondary data (151-156) relates to at least one color value which is to be assigned to a color 
code. 

25 

13. Method according to Ciaim 12, characterised in that the color code is 
represented by at least 6 bits. 

14. Method according to Claim 11, characterised in that a data structure (5) 

30 comprising shape data (5.3) representing shape properties of the graphics object is read from a 
location at the record canier (1) which is referred to by the primary data (130. 1) before the 
step of requesting user input. 
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15. Method according to Claim 14, characterised in that the datastructure (5) 
comprises further data, in that the secondary data (151-156) is related to the additional visual 
property in that the secondary data comprises modification data which includes a reference 
indicating the location of said further data within the datastructure (5), the datastructure being 

5 stored in a memory before user input is requested, and the further data being retrieved from a 
location in the memory indicated by the reference comprised in the secondary data after user 
input has been received. 

16. Method according to Claim 15, characterised in that the further data comprises 
10 one or more color values. 

17. Record carrier (1) on which is recorded at least 

a first stream of data (2) representing a video item, 

a second stream of data (3) representing a graphics item, 

15 a control program (4) for controlling interactive playback of said items, which 

program (4) has a first program portion (130) which comprises primary data (130.1), relating 
to shape properties of a graphics object and a second program portion (140) which is to be 
executed after the first program portion in case of compliance of user input with a 
predetermined condition specified in the program, which second program portion (140) 

20 specifies a visual feedback in response to the user input, 

characterised in that the second program portion (140) comprises secondary data (151-156), 
relating to at least an additional visual property of the graphics object. 

18. Record carrier according to Claim 17, characterised in that the graphics object 
25 comprises two or more parts (201-207) having mutually different color codes, and in that the 

secondary data (151-156) relates to at least one color value which is to be assigned to a color 
code. 

19. Record carrier according to Claim 1 7, characterised in that the color code is 
30 represented by at least 6 bits. 



20. Record carrier according to Claim 17, characterised in that the primary data 

(130.1) is related to the shape properties in that the primary data comprises a reference to a 
data structure (5) comprising shape data (5.3) representing the shape properties. 
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21. Apparatus according to Claim 20, characterised in that the datastructurc (5) 
comprises further data and in that the secondary data (151-156) is related to the additional 
visual property in that the secondary data comprises modification data which includes a 
reference indicating the location of said further data within the datastructure, the modification 

5 data and the further data representing the additional visual property. 

22. Record carrier according to Claim 2 1 , characterised in that the further data 
comprises one or more color values. 

10 23. Record carrier according to Claim 17, characterised in that the data comprised 

in the second stream (3) and the data related to the graphics object are in a form which can be 
processed by common graphics generating means. 

24. Record carrier according to Claim 17, characterised in that, the shape properties 
15 of the graphics object are represented in the fonm of runlength encoded data. 

25. Method of manufacturing a record carrier (1) according to which method 

a first stream of data (2) representing a video item is stored at the record carrier, 
a second stream of data (3) representing a graphics item is stored at the record 

20 carrier, 

a control program (4) for controlling interactive playback of said items is stored 
at the record carrier, which program (4) has a first program portion (130) which comprises 
primary data (130.1), relating to shape properties of a graphics object and a second program 
portion (140) which is to be executed after the first program portion in case of compliance of 
25 user input with a predetermined condition specified in the program, which second program 
portion (140) specifies a visual feedback in response to the user input, 
characterised in that the second program portion (140) comprises secondary data (151-156), 
relating to at least an additional visual property of the graphics object. 



WO 00/36600 PCT/EP99/08958 

1/4 




HEADER 


CLOT -DATA 


SHAPE DATA 


MODI 
C 


: ICATION 
ATA 


I I 





5.1 5.2 5.3 5.4 



FIG. 1A 



WO 00/36600 



PCT/EP99/08958 



2/4 




FIG. 2 



201. 

202- 
203- 



204 



Choose an option 

Option 1-205 
■> Option H-206 
:;> Option 10-207 



-200 



FIG. 3 



WO 00/36600 



PCT/EP99/08958 



3/4 




FIG. 4 



WO 00/36600 PCT/EP99/08958 




INTERNATIONAL SEARCH REPORT 



PCT/EP 99/08958 



A. (XA881RCAT10K OF SUBJECT HATTER 

IPC 7 611B20/00 G11B27/32 811B27/34 






Aooordtog to International Paten! Oanfflix^ (IPC) or to botti riaflonal dasslflcata a 


ndlPC 




a REUD8 SEARCHED 


Mnftmm doounentatton aeeiohed (ctaesAcaaon cystem folowd by claaafflcotkn eyrrtoa) 

IPC 7 611B 


Doa*T>errtadon searched other than m*-irT»*n dc»*T**Ttttflon to toe eUcrtt thai euoh 0. 


XXUTWC8 are tr 





Bectronte data base coneuted during the totemaaonal search (name of date be— and. where prececal, search terms used) 



& DOCUMENTS CONStDERED TO BE RELEVANT 



Category ' 



Cttaflon of document wflh todtoe o dn, where appropriate, of fhe relevant passages 



Relevant to dean No. 



ZORAN: "Super VCD; SupraAVpl ayer reference 
design" 

WWW. ZORAN. COM, November 1998 (1998-11), 
pages 1-2, XP002 127882 

ESS TECHNOLOGY: "ESS, SONY, PHILIPS and 
ENREACH JOINTLY LAUNCH SUPER VCD 
SOLUTIONS" 

WWW . ESSTECH . COM/NEUSRO0N/1998/10-7-98 . HTN , 
7 October 1998 (1998-10-07), pages 1-3, 
XP002127883 

SONIC: "Sonic Solutions Debuts Industry's 
First Integrated DVD and Super Video CD 
Production System" 

WWW.SONIC . COM/HTML/PR/PRJ>VD_VCD.HTML, 
24 November 1998 (1998-11-24), pages 1-2, 
XP002127884 

-/— 



1,11,17, 
25 



1,11,17, 
25 



1.11,17, 
25 



Further documents are leted In the oordtouaflon of boot C. 



Potent famDy member* c 



* Special categories of cited documente : 

"A" documen t deftotofl the general etate of the art which b not 

considered to be of particular refevanoe 
*€" eadler document but puttahed on or after (he h tc t nafl onaf 

Ding date 

Tfc* document which may throw doubts on priority otatoXs) or 
which la ottod to establish the publlcaflon date of another 
^Jtflffa ttv or otoer aparia ) reaaon (as apo cttod) 

XT document rHefrtng to an oral otsotoaure, use, exhMonor 



later document pubflehed a 
or priority date and not to oonOJot with 



pUblahed prtof t o toe totemafionaJ Stog date but 
later than toe priority date claimed 



Stog date 
taatton but 
undettytng file 



"X* documera of particular relevance; fhe claimed toventton 
cannot be considsrsd novel or cannot be considered to 
hvcrv© on bwertfv© etep when the document t* token c 

*Y* documen t of partta Uar i c t e v o no e ; fhe c laime d tonsnflon 
cannot be considered to Involve an tovertflvo atep when toe 
dooument la oombtoed wHh one or more other such doou- 
meres, auoh oombtoaoon being obvtoue to a person a 
to toe art. 

"ft* dooumen t member of fhe aaroec 



Date of the actual completion of toe totemaflorai seejoh 

17 January 2000 



Data of mating of the fntemaflonaJ search report 

28/01/2000 



Name and maStog address of (he ISA 

European Patent Office. PJB. 5610 PetanUaan 2 
f&-2280HVra>wtJi 
TeL (+31-70) 340-2040, Ta. 31 661 epo ri. 
Fax (431-70) 340-3016 

f^fCTASACTO (man* tfweQIJUV 1002) 



Van Staveren, M 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



PCT/EP 99/08958 



C(Con*MMtion) DOCUMENTS CONSIDERED TO BE RELEVANT 



C flTgq wy * Cltaflcn ot doouncni valtft frwfcQ0cn.v,here appropriate, ot tho retevent passage* 



Rdevw* to dc*n Mo. 



EP 0 762 422 A (HITACHI) 
12 March 1997 (1997-03-12) 
column 5, line 11 -column 26, line 20; 
figures 3,7 

P,A ROYAL PHILIPS ELECTRONICS: "Super Video 
CD Designer Release 1.5.0; User Manual" 

http://uww.licensins.philips.com/nehoptica 

L/NEWSVCD . HTML , 1 June 1999 (1999-06-01), 
pages 1-21, XP002127885 
page 9, line 1 -page 14, last line 



1,11,17, 
25 



1,11,17, 
25 



Form PCM8A01O (ooMMtol of Moon* rtwt) IMy 1MB) 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 

i potent tamfy nwabm 



PCT/EP 99/08958 



Patent famfly 



rti iiniinHnn 

rwNBSon 



EP 762422 



12-03-1997 



JP 
CN 
US 



9128408 A 
1146119 A 
5909551 A 



16-05-1997 
26-03-1997 
01-06-1999 



Food KWUIO ((MM Mty mt ttty 1 MO) 



